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Abstract. Evidence-Based Reasoning (EBR) 
is a framework of inquiry-based teaching 
for developing scientific reasoning. This 
research aims to analyze the effectiveness 
of EBR in inquiry-based Physics teaching 

to improve students’ scientific reason- 

ing. Applying Slovin formula for sample 
determination, the research involved 139 
upper-secondary school students with 
similar prior knowledge. This research used 
one group pre-test post-test design with 
replication. The effectiveness of teaching 
on improving scientific reasoning was ana- 
lyzed by using Paired Sample T-test. ANOVA 
was used to analyze the consistency of the 
teaching effectiveness across in test group. 
The findings indicated that EBR effectively 
improved students’ scientific reasoning in 
inquiry-based Physics teaching based on 
two main grounds. On the first, the sig- 
nificance was ensured by N-gain category 
of scientific reasoning component, which 
proved (a) control of variables reaching 
high category, (b) proportional thinking 

at moderate category; c) probabilistic 
thinking reaching moderate category, (d) 
hypothetical-deductive reasoning attain- 
ing low category; and (e) correlational 
thinking achieving low category. In addi- 
tion, the level of scientific reasoning has 
attained the experience characterized by 
slightly imperfect answers. Students voiced 
positive response to EBR, which stated that 
it helped them engage in scientific reason- 
ing in Physics learning. They also voiced the 
general opinion on EBR and inquiry-based 
learning in general. 
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Introduction 


The transfer of learning calls forth meaningful learning process relevant 
to the characteristics of subject being learnt. Physics encompasses charac- 
teristics pertinent to concepts and mathematics through scientific method. 
Inquiry has been the cornerstone of effective science learning to construct 
knowledge through scientific method and reasoning since the 1960s (Barz 
& Achimas-Cadariu, 2017; Sudria, Redhana, Kirna, & Aini, 2018). Inquiry- 
based teaching has been applied by Education Minister Regulation of the 
Republic of Indonesia of 2016 as a standard of the teaching process through 
experiment, representation of experimental results in the form of a table, 
graph, and argument. The preparation of scientific argument is done orally 
and written to empower students’ reasoning in that they are encouraged 
to ponder the characteristics of certain subjects, especially Physics on the 
topic of heat (Kant, Scheiter, & Oschatz, 2017). The learning process in Physics 
not only requires theoretical content of Physics in the form of fact, concept 
or principle but also calls for investigation, evidence collection, analyzes 
and evaluation on the understanding of Physics (Erlina & Wicaksono, 2016; 
Toplis, 2015). Mastering empirical Physics content requires evidence or fact 
and systematic reasoning result from investigation to encourage meaning- 
ful teaching Physics (Cepni, 2017; Erlina, Susantini, & Wasis, 2017; Susantini, 
Faizah, Prastiwi, & Suryanti, 2016). 

Knowledge of Physics content has a strong relationship with scientific 
reasoning (Ewen, Schurter, & Gundersen, 2012; Moore & Rubbo, 2012). The fact 
shows that scientific reasoning is still relatively weak and hardly developed 
in learning Physics content. For example, students’ investigation for answers 
is not accompanied by scientific reasoning (Kisiel, Rowe, Vartabedian, & Kop- 
czak, 2012). In addition, high upper-secondary school students’ in Surabaya 
results show that they are found to reach only the average score of 38.7 (low 
category) with respect to scientific reasoning ability. The results of similar 
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research also indicate that scientific reasoning of high upper-secondary school students in Jember is still low, as 
marked by an average score of 27.22 (Erlina, Wasis, & Rosyid, 2016). Students have difficulties in defining experi- 
mental variables and interpreting as well as analyzing graphs or data. Students’ low scientific reasoning is evinced 
by the fact that they are able to choose mathematical equations correctly, but there is still potential ambiguity 
when determining its meaning (Brookes & Etkina, 2015). 

Low scientific reasoning results form several downsides. First, the development of scientific reasoning in 
learning is still poor. This poor development is characterized by a narrowed discussion of abstract ideas with mini- 
mum communication. Moreover, the demand of Science examination is still limited to low-level cognitive form of 
memorization and understanding, rather than testing analytical skills and high-level reasoning (Kind & Osborne, 
2017; Piekny & Maehler, 2013). Another issue is related to scientific reasoning process and has not been involved 
in the laboratory experiment. Students spend more time collecting data or implementing procedures rather than 
discussing data analysis, interpreting data, and drawing conclusions (Dolan & Grady, 2010). The other shortcoming 
is concerned with the application of inquiry diverting from the philosophical foundation and theoretical study, 
which is still common among teachers when constructing students’ knowledge. The advantages of constructing 
knowledge by inquiry include increasing students’ reasoning in the ability of free thinking (Coiro, Castek, & Quinn, 
2016). The resultant free thinking, in fact, diverts inquiry from achieving its actual goal. The implementation of 
inquiry is generally done directly, leading to the hypothesis testing stage rather than to the preparation of hypoth- 
eses (Dolan & Grady, 2010; Thoron & Myers, 2012). 

Inquiry-based teaching provides an opportunity to build insights into facts in the surrounding environment 
(Vlaardingerbroek, Taylor, Bale, & Kennedy, 2017). Constructivist perspective as the underlying philosophical 
framework of inquiry finds the prior knowledge and students’ role as a discoverer to predict and explain physical 
phenomena/concepts (Buell, Greenstein, & Wilstein, 2017; Edwards & le Grange, 2017). Students are required to 
collect relevant information and use it as a basis for formulating hypotheses, analyzing data, and linking fact and 
concept that underlie the process of drawing conclusions and problem solution (Chen, Wang, Dede, & Grotzer, 
2017; Erlina, Jatmiko, & Wicaksono, 2015; Pandiangan, Sanjaya, Gusti, & Jatmiko, 2017). Inquiry teaching requires 
the instructional design that emphasizes the process of analytical thinking to seek and to find out the answer to 
a problem at hand (Akkuzu & Uyulgan, 2017; Erlina, Jatmiko, & Raharjo, 2016). The role of scientific reasoning is 
required to formulate the question and determine interpretation that is not supported by reliable evidence (Metz, 
2017). The preparation of drawing conclusions from inquiry activities requires the identification of assumptions 
and critical as well as logical thinking skills (Lederman, Lederman, Bartos, Bartels, Meyer, & Schwartz, 2014). The 
scientific reasoning which is developed based on the basis of a dual-process theory produces rational, logical, and 
systematic thinking process to develop scientific reasoning (Amsel, Klaczynski, Johnston, Bench, Close, Sadler, & 
Walker, 2008). The implementation of inquiry-based teaching calls for analysis, interpretation, and application to 
improve the quality of logical reasoning, argument, and conclusion. Teaching activities provide students the op- 
portunities to construct logical claims which are contained in Evidence-Based Reasoning (EBR) (Brown, Nagashima, 
Fu, Timms, & Wilson, 2010). 

EBR is an inquiry-based framework which is able to generate scientific reasoning in experimental and pre- 
dictive activities. EBR aims to support students’ and teachers’ understanding of the scientific reasoning process, 
examine and identify the development of scientific reasoning, and assess scientific reasoning in the formative and 
summative assesment. This framework shows two inputs in the form of premises and data processed through three 
different steps, comprising of analysis, interpretation, and application to create claims. Claims as outputs are based 
on a hypothetical-deductive reasoning process. The conclusion of hypothetical-deductive results in the form of 
scientific knowledge is constructed from the generalization of data, evidence, and rules (Brown, Nagashima, Fu, 
Timms, & Wilson, 2010). EBR uses generalization results as general knowledge that can develop specific knowledge 
and reasoning. In addition, EBR can develop scientific reasoning based on phenomena (Hardy, Kloetzer, Moeller, & 
Sodian, 2010). Cognitive psychology is divided into two main aspects to develop scientific reasoning, namely the 
investigative process of procedural knowledge and the inferential process of conceptual knowledge (Pelamonia 
& Corebima, 2015). These two main aspects can be actualized in an inquiry-based Physics teaching where an in- 
quiry approach effectively can help students develop their ability to link scientific evidence and findings (Sutman, 
Schmuckler, & Woodfield, 2010). The consistent and logical linkage of evidence and scientific findings requires the 
implementation of EBR in inquiry-based Physics teaching to improve students’ scientific reasoning. 

EBRin inquiry-based Physics teaching has the advantages of providing two inputs of premise and data through 
three different reasoning processes (analysis, interpretation, and application) in the inquiry process. The process 
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of reasoning encompasses: (1) analysis, which relates to collecting and linking observation results to produce 
and describe a statement as evidence; (2) interpretation, changing the evidence into a fairly general statement 
(linking evidence to the rule) before being applied in a new situation to make the evidence meaningful; and (3) 
application, describing the relationship rules that support certain things which are described by the premise. The 
scientific reasoning using EBR, especially in inquiry-based Physics teaching, can show how competent students 
are to perform the components of scientific reasoning, i.e. control of variables, proportional thinking, probabilis- 
tic thinking, correlational thinking and hypothetical-deductive reasoning (Ding, Wei, & Liu, 2016; Lawson, 2000; 
Piraksa, Srisawasdi, & Koul, 2014). 


Research Problem 


The present study was backgrounded by the fact that the students’ scientific reasoning ability was hardly 
developed. The scientific reasoning ability under investigation was considered weak, regardless of the implemen- 
tation of inquiry-based learning as stipulated in the curriculum (Erlina, Wasis, & Rosyid, 2016). The problem in this 
research was to analyze how effective EBR can improve students’ scientific reasoning in inquiry-based Physics 
teaching. EBR was said to be effective when the teaching process statistically resulted in a significant increase in 
students’ test scores before and after learning, which were atomized into the five components of scientific reason- 
ing defined by the N-gain score. 


Research Focus 


The focus of this research was to analyze the effectiveness of EBR on inquiry-based Physics teaching on 
scientific reasoning with respect to the components of scientific reasoning. The analysis included the following 
questions: (1) are there significant (statistical) effects on scientific reasoning before and after the teaching process 
using EBR?; (2) what is the category of scientific reasoning achieved after the EBR application?; and (3) is there a 
difference in the increase of students’ scientific reasoning in the 4 test groups? 


Methodology of Research 
General Background 


The scope of this research was concerned with the application of EBR to improve students’ scientific reasoning. 
The research focused on the formal operational stage using Physics subject concerning Heat in odd semester of 
Academic Year 2017/2018. Scientific reasoning was analyzed to determine whether there were different pre-test 
and post-test scores. N-gain calculation could be used to categorize students’ scientific reasoning on the Physics 
subject whether they were in high, moderate, or low category in the 4 test groups. N-gain calculation could be 
used to categorize students’ scientific reasoning whether they were in high, moderate, or low category in the 4 
test group upper-secondary school 3 Jember, East Java. 


Research Sample 


The research involved 139 students from the population of 213 students in upper school who had moderate 
criteria based on the average scores achieved in the national exams. The number of the research samples were 
determined based on the Slovin formula with error margin of e = 5% i.e. [sample = population / 1 + (population 
x e’)] (Sevilla, Ochave, Punsalan, Regala, & Uriarte, 1984). Students were divided into 4 test groups with the same 
basic concept and scientific reasoning characteristics i.e. C1 (36 students), C2 (35 students), C3 (35 students), and 
C4 (33 students). 


Instrument and Procedures 
This research was conducted using pre-test and post-test design with 4 replications (Fraenkel, Wallen, & Hyun, 


2012). Scientific reasoning test which used pre-test was given before the treatment, and post-test was given after 
the EBR in inquiry-based Physics teaching was implemented. The implementation of EBR in the teaching process 


974 


WSs 


Journal of Baltic Science Education, Vol. 17, No. 6, 2018 


ISSN 1648-3898 /Print/ THE EFFECTIVENESS OF EVIDENCE-BASED REASONING IN INQUIRY-BASED PHYSICS 
TEACHING TO INCREASE STUDENTS’ SCIENTIFIC REASONING 
ISSN 2538-7 138 /onines (P. 972-985) 


was related to syllabus, lesson plans, and student worksheets. The stages of EBR activities in inquiry-based Phys- 
ics teaching consisted of analysis, interpretation, and applications. The EBR framework in inquiry-based Physics 
teaching is as follows. 


Table 1.7 Framework of EBR in inquiry-based teaching. 


Activity Scientific Reasoning Result 


Premise 


1. Define a problem Question 








Hypothesis formulation 
2. Develop a hypothesis Analysis Control of variables Experiment variable 
Experiment result data 























; Proportional thinking Evidence-based on experiment Result 
3. Search for evidence 
Probabilistic thinking data 
Rules 
4. Draw a conclusion Interpretation Hypothetical-deductive reasoning 
Deductive hypothesis 
Claim (relation premises and rules) 
my ie te edequary of the Application Correlational thinking 
conclusion Explanation claims 


The evaluated scientific reasoning components consisted of (1) Control of Variables (CV), i.e. identifying in- 
dependent variables and dependent variables; (2) Proportional Thinking (PPT), i.e. determining the relationship 
between variables using numbers, mathematical equations, tables, and graphs; (3) Probabilistic Thinking (PBT), 
i.e. predicting the resulting opportunity obtained when conducting replication; (4) Hypothetical-Deductive Rea- 
soning (HDR), i.e compiling a hypothesis based on a general concept to a specific concept; and (5) Correlational 
Thinking (CT), i.e. creating mutual relationships (interrelated or unrelated) between variables (Piraksa, Srisawasdi, & 
Koul, 2014). Mastering concept in the pre-tests as a basic ability in scientific reasoning, referring to revised Bloom's 
taxonomy, consisted of remembering, understanding, applying, analyzing, evaluating, and creating (Lee & She, 
2010; Williams, 2017). 

The scores of students’ scientific reasoning responses using three-tier-test items were described as follows. 
First, the students were able to choose the first option correctly. Also, the reason was perfectly correct on the 
second level. They were sure with the answer (score 4). At a lower level, the students were able to choose the first 
option correctly, but the reason was slightly imperfect on the second level. Also, they were sure with the answer 
(score 3). At score 2, the students were able to choose the first option correctly, yet the reason was incorrect on the 
second level. Moreover, the students were sure of the answer. At score 1, the students were sure with the incorrect 
alternative answer on the first level. Lastly, the students were sure with the wrong answer or the students were 
unsure of the answer (score 0) (Kirbulut & Geban, 2014). 


Data Analysis 


The students’ answers indicating scientific reasoning were analyzed at each level, consisting of (1) expert, i.e. 
showing perfect answer marked by correct answer through a coherent argument; (2) experienced, i.e. showing 
slightly imperfect answers indicated by correct answer through incoherent argument; (3) competent, i.e. showing 
answers resulting from memorization; and (4) novice, i.e. showing answers lacking knowledge or indicating miscon- 
ception in scientific reasoning. The score range for each level was as follows: (1) expert, marked by correct answer 
ranging from 75% to 100%; (2) experienced, marked by correct answer ranging from 50% to 75%; (3) competent, 
marked by correct answer ranging from 25% to 50%; and (4) novice, marked by correct answer ranging from 0% to 
25% (Hagen & Creek, 2014). The increase in scientific reasoning was based on the N-gain (post-test score — pre-test 
score) / (100 - pre-test score) (Hake, 1998) based on the following criteria: (1) N-gain = .70 (high); (2) .30 < N-gain 
< .70 (moderate); and (3) N-gain < .30 (low). 

The effectiveness of EBR application on inquiry-based Physics teaching on improving scientific reasoning was 
determined by the scores achieved on the pre-test and post-tests. The difference was analyzed by using Paired 
Sample T-test. The Signed Rank Test or Wilcoxon Sign Test was used to check whether data normality or non- 
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parametric data were evident. Furthermore, the consistency analysis on improving students’ scientific reasoning 
used N-gain calculation of each test group, employing Analysis of Variance (ANOVA). The Kruskal-Wallis Test would 
be applied when normality or non-parametric data was ensured. Students’ opinions about the application of EBR 
to scientific reasoning were analyzed descriptively and qualitatively by using the Guttman scale (Guttman, 1944). 
Students who answered Yes would get 1 and students who answered No would get 0. 


Results of Research 


This research presented the entire supporting data of the effectiveness of EBR in inquiry-based Physics teach- 
ing with respect to the following aspects: (1) mastering the prior concept; (2) pre-test and post-test of scientific 
reasoning; (3) N-gain scientific reasoning; (4) statistical analysis of scientific reasoning consistency; and (5) student 
response to teaching. Figure 1 shows the percentage of N-gain criteria of scientific reasoning components in 4 
groups. The percentage of students with N-gain reaching high criteria on the control of variables component out- 
numbered those of the other components. Different results were evident in components of hypothetical-deductive 
reasoning and correlational thinking, i.e. the largest percentage of students’ N-gain was achieved at low N-gain 
value. Table 2 shows the N-gain value of each component of students’ scientific reasoning. N-gain on control of 
variables, proportional thinking, probabilistic thinking, hypothetical-deductive reasoning and correlational think- 
ing was high, moderate, moderate, low, and low respectively. 

High increase of variable control showed that most students had good answers. For example, when students 
worked on the equation about heat, AQ/At =k A (AT/I), they were able to determine relevant variables to investigate 
the effect of steel length on the rate of heat transfer. An example of problem requiring proportional thinking was 
when students analyzed data from the experiment of heat transfer by conduction. Students were able to deter- 
mine the comparison of temperature changes (AT )at test point 1 and test point 2, after test point 1 indicated a 
reduction in length. Students’ answers with respect to probabilistic thinking demonstrated that they were able to 
determine temperature changes in metal reference point 2 when metal reference point 1 indicated a reduction in 
length. The students made mistakes in deductive hypothetical reasoning. Students were given scenarios related 
to heat transfer in several metals (copper, steel and aluminum) accompanied by the analysis results showing that 
the highest rate of heat transfer was evident in copper, compared to the other two metals. Students chose the 
wrong answer, that was reducing copper length, as they assumed that shorter metal would lead to higher rate of 
heat transfer. The components of correlational thinking between variables indicated low results. 
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Figure 1. Percentage of n-gain criteria of scientific reasoning components in 4 groups. 
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Table 2. The average prior knowledge, post-test, and N-gain student scientific reasoning in 4 groups. 











oz. The Average of Conipenents The Pre-Test Average The Post-Test Average ‘ 
Group Cognitive Level ‘ of Scientific ene : ee : N-gain 
Prior Knowledge : of Scientific Reasoning _ of Scientific Reasoning 
Reasoning 
CV 3 
oe =< 22.08 63.06 a 
el sine) se = (Novice) (Experienced) Se 
HDR 34 
CT 21 
CV al 
PPT 67 
31.54 —— 
C2 (< Standard) PBT ze oe 68 
. eS (Novice) (Experienced) se 
Remembering HDR 4 
Understanding — —_ 
Applying CT 19 
Analyzing cv 74 
Evaluating <<< —<— 
en 43.44 ——_ 21.29 60.14 —— 
(< Standard) os ENS (Novice) (Experienced) =, 
HDR 24 
CT 21 
CV 3 
PPT 65 
43.93 —<— ae oD 21.21 65.45 aa 
cas (< Standard) ie 2 (Novice) (Experienced) ee 
HDR 35 
CT 22 


Table 2 shows the average of mastering prior knowledge and scientific reasoning ability each student gained 
after various teaching strategies were implemented as a general inquiry routine in 4 groups. Students’ mastery of 
the prior knowledge was categorized as low, which was still below the national passing standard, while the average 
score of the pre-test scientific reasoning was marked at a novice level. It indicated students’ answers which lacked 
knowledge or tainted with the error in the concept of scientific reasoning. The average scores resulting from EBR 
implementation in inquiry-based Physics teaching in Table 2 show experienced level corresponding to scientific 
reasoning test results in each group. This category was characterized by the correct answer, although imperfect. 

The statistical analysis of scientific reasoning is shown in Table 3. The effective teaching of scientific reasoning 
on each component of scientific reasoning across the groups showed the same result, as shown by all significant 
2-tailed asymptotic results for the p-value < .05 applied to parametric tests. Table 3 concludes that EBR poses a 
significant effect on students’ scientific reasoning with a significance level of 5%. A consistency analysis of EBR 
application was conducted when the students’ N-gain scientific reasoning in 4 test groups indicated the normal 
distribution and homogenous. The ANOVA Test results on each component of scientific reasoning gained 2-tail 
asymptotic significance for p > .05. Table 4 concludes that there is no significant difference in the application of 
EBR in inquiry-based Physics teaching toward students’ scientific reasoning in 4 groups, with a significance level 
of 5% on each component of scientific reasoning. 
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Table 3. The result of statistic using paired sample t-test on students’ scientific reasoning. 





















































Group Scientific Reasoning Components Mean N t df SD p 
CV 2.36 36 19.59 35 12 < .0001 
PPT 1.93 36 14.26 35 14 < .0001 
C1 PBT 2.03 36 18.60 35 65 < .0001 
HDR 93 36 7.32 35 67 < .0001 
CT 18 36 7.32 35 64 < 0001 
CV 2.26 35 18.01 34 14 < .0001 
PPT 1.94 35 15.85 34 12 < .0001 
C2 PBT 2.11 35 18.50 34 68 < .0001 
HDR 86 35 6.92 34 ind < .0001 
CT M1 35 6.33 34 67 < 0001 
CV 2.14 35 18.74 34 66 < .0001 
PPT 1.89 35 16.50 34 68 < .0001 
C3 PBT 2.09 35 16.41 34 AT < .0001 
HDR 89 35 7.07 34 68 < .0001 
CT 18 35 7.15 34 65 < 0001 
CV 2.33 33 17.25 32 18 < .0001 
PPT 1.98 33 12.68 32 19 < .0001 
C4 PBT 2.10 33 15.61 32 18 < .0001 
HDR 82 33 6.13 32 16 < .0001 
CT 68 33 6.16 32 10 < .0001 





The statistical tests results on the consistency of EBR applications in inquiry-based Physics teaching across 
groups are as follows. 


Table 4. The result of ANOVA statistic test on the students’ scientific reasoning components in 4 testing 


























groups. 
Scientific Reasoning Components Sum of Squares df F p 
CV 6.300 2.007 .069 
PPT 7.686 1.386 217 
PBT 5.715 138 1.619 £135 
HDR 8.741 1.647 128 
CT 4.129 1.389 215 


The results of student responses to the EBR process are shown in Table 5. Students voiced positive responses to 
the learning with which they were engaged. Table 5 provides information on scientific reasoning that was not fully 
mastered by students, namely to develop a deductive hypothesis based on general theory and to determine the 
interrelationship between variables. Data of student response on scientific reasoning activities were also supported 
by responses to the EBR process and inquiry-based learning in general. Only some students were able to describe 
premise presentation, make a logical connection, confirm knowledge, ask the question, and communicate data. 
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Table 5. Student responses on EBR application. 
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The Percentage of Students Who Answered ‘Yes’ (%) Average 
Criteria 
C1 C2 C3 C4 
Teaching activities can help students engage in scientific reasoning: 
a. Control independent and dependent variables 97.22 100 97.14 100 98.59 
b. Relationship among mathematical equation, table, and graph 100 100 97.14 100 99.29 
c. Prediction of opportunity in replication 100 97.14 94.29 100 97.86 
d. Deductive hyphothesis based on general theory 83.33 71.43 80 84.85 79.90 
e. Reciprocal relationship (related or unrelated) 72.22 68.57 62.86 72.73 69.09 
Teaching activities can help students describe the EBR: 
Analysis 
a. Presentation of the premise takes the attention to learn 72.22 65.71 60 84.85 70.70 
b. Data collection based on hands on and minds on 100 100 100 100 100 
c. Probing empirical evidence 100 100 97.14 96.97 98.53 
Interpretation 
d. Rules bridges data relationship with Physics concepts 97.22 100 97.14 96.97 97.83 
Application 
e. Claims make logical connection between premise and rule 80.56 11.43 68.57 75.76 74.08 
f. Confirm the knowledge progress 63.89 65.71 60 100 72.40 
Teaching activities can help students describe inquiry-based learning 
in general: 
a. Observation 100 100 97.14 100 99.29 
b. Asking and answering question 77.18 71.43 68.57 81.82 74.90 
c. Searching information 97.22 94.29 100 100 97.88 
d. Collecting data 100 100 100 100 100 
e. Analyzing data 100 91.43 97.14 100 97.14 
f. Communicating data 77.78 60 62.86 72.73 68.34 
g. Constructing knowledge based on experience 100 97.14 100 100 99.29 


*C: Testing Groups 


Table 5 concludes that more than 50% of students confirm learning using EBR in inquiry-based Physics 
teaching helps them to engage in scientific reasoning, to describe the EBR learning, and to describe inquiry- 
based learning in general. 


Discussion 


Information from Table 2 shows the students’ average prior knowledge in 4 groups before the implemen- 
tation of EBR in Physics teaching. The mastery of concept was categorized as low, which was still below the 
national passing standard. The low mastery of students’ concepts was influenced by less meaningful learning 
process even though the inquiry-based teaching process became an obligation (Wicaksono, Madlazim, & Wa- 
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sis, 2017). Students actively searched information pertinent to Physics only to accomplish low-level cognitive 
thinking questions in the form of rote definition, recalling the Physics formulas, applying Physics formulas with 
simple mathematical operations, and reading single graphs. In addition, the number of students’ cognitive 
performance reaching high level in Physics learning examination was still low. The types of problem in the 
examination did not contain high-level questions, even though students mastered Mathematics skills needed 
to solve problems in Physics. The mathematical skills that students mastered did not help them to apply con- 
cepts to certain context in Physics (Motlhabane, 2017). In addition to the low achievement, the information that 
students gained to support their work on Physics resulted from free learning resources without a facilitator. 
Freedom of information generated a collection of irrelevant information that became the trigger for student 
misconceptions (Erman, 2017). Low thinking claim process along with unclear information was the factor causing 
students’ low meaningfulness in learning, so it influenced the mastery of Physics concept. Constructivist learn- 
ing theory suggests that teachers should encourage and direct students’ attention to important concepts to 
learn and to connect new material with known things (prior knowledge) as they interact with the environment 
(Moreno, 2010). The theory contributes to the need for the involvement of students’ thinking skills to construct 
knowledge by involving data, evidence, and rules. As such, learning leads to meaningful understanding (Brown, 
Nagashima, Fu, Timms, & Wilson, 2010). 

The pre-test result of students’ indicated the average students scientific reasoning reaching novice level. 
It indicated that the answers were characterized by the lack of knowledge or misconceptions in doing scien- 
tific reasoning. The low scientific reasoning was caused by the application of inquiry teaching, which diverted 
from the philosophy of inquiry. However, this erroneous reasoning has become the provision of curriculum 
competence. Teachers do not emphasize hands-on and minds-on activities in inquiry-based Physics teaching 
so that students are less involved doing analysis, interpretation and elaborating theoretical and mathematical 
Physics concepts. Another impact was that the ability of scientific thinking became underdeveloped, though 
the inquiry-based teaching is applied because students were not trained for analyzing, synthesizing, and creat- 
ing (Azar, 2005; Cepni, 2017). Students experienced difficulty in performing high-level thinking and practicing 
reasoning patterns. As a corollary, this limitation led to the failure of achieving scientific reasoning in inquiry 
teaching implemented. Piaget's cognitive development model states that students have different stages of 
development prior to reaching the stage of formal operational reasoning, which is scientific reasoning. Piaget’s 
theory contributes to optimizing the stage of student development through scientific reasoning inquiry pro- 
cess because scientific reasoning is the end of the developmental ability and the characteristic of intellectual 
maturity that can be trained (Piaget, Inhelder, & Piaget, 2013). 

The implementation of EBR in inquiry-based Physics teaching resulted in the experienced level as shown 
by the average scores of the scientific reasoning test results in each group. It showed the category of slightly 
imperfect answer with the correct choice of the answer through incoherent arguments. The result of learning 
scientific reasoning at experienced level was characterized by the ability to build general concepts or support 
arguments theoretically, and the experiment results were obtained from through hands-on and minds-on 
activities. The hands-on activity allowed students to collect data through experiment and laboratory activi- 
ties, so it motivated students’ motor sensory to concretize their alternative concepts (Tajudin & Chinnappan, 
2016). EBR teaching activated students’ abstract thinking abilities in inquiry learning as minds on activity by 
making logical connections between premises and rules. When analysis focused on the students’ responses, all 
students reported that they were able to engage in probing relevant information and evidence when conduct- 
ing inquiry, but some students were still having difficulty doing the correlational thinking. The stages of EBR 
in inquiry-based Physics teaching were in line with the search for relevant information where students knew 
the relevance of the evidence and theory or concept. As a result, a problem can be solved easily (Slavin, 2009). 
Evidence-based teaching is in line with constructivist learning. Constructivist philosophy gives students the 
flexibility to think through inquiry activities as new experiences which are internalized through previous or 
existing experience (Akpan & Beard, 2016). 

Table 2 shows the N-gain of each component of students’ scientific reasoning. The N-gain of variable con- 
trol’s component reached high category. Students who achieved high category achieved a greater percentage 
than the number of students in the category of moderate and low. It is shown in Figure 1, most students were 
able to choose the alternative choice on the first level correctly, the reason was perfectly correct on the second 
level, and they were confident with the answer. When students were given the heat concept in mathematical 
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equations, they were able to determine the variables to investigate the effect of steel length on the rate of heat 
transfer. Students also presented scientific explanation concerning the fact that the variation in metal length 
was obtained by determining the test point of the heat source. Therefore, the rate of heat transfer could be 
known. Control of variable is a basic ability of the learning process in school and science literacy, but it will 
not develop without instruction (Schwichow, Croker, Zimmerman, Hoffler, & Hartig, 2016). Most students were 
capable of controlling variables because EBR teaching presented a premise that expressed an initial statement. 
For example, this metal rod has a short size. The presentation of initial statement was relevant to the research 
results which indicated that the expression of statement is useful to draw students’ attention in the learning 
process (Wecker, 2013). This research showed that the initial statement of the premise was able to stimulate 
students to recall the magnitudes of Physics concepts because it was in line with the theory of information 
processing. Information processing theory suggests that the ways of presenting information can influence the 
ways by which students process information (Joyce, Weil, & Cahoun, 2009). 

The implementation of EBR in inquiry-based Physics teaching resulted in N-gain of proportional and 
probabilistic thinking components in moderate category. Table 2 and Figure 1 show that the N-gain of com- 
ponent of proportional thinking in moderate category, which was also marked by the most percentage of 
N-gain. The results of scientific reasoning test generally showed that the first level of choice alternative was 
correct. The reason on the second level was slightly imperfect, and the students were sure with the answer. 
Students were able to determine the temperature change on the metal at reference point 2 when the metal 
at reference point 1 had along reduction, but they still had difficulty in delivering the argument behind their 
answer clearly. Proportional reasoning illustrates important concept and thinking required to understand level, 
ratio, and proportionalities, including scale (Norton, 2005; Nunokawa, 2012). The N-gain corresponding to the 
proportional thinking skill in moderate category was supported by the research result indicating that the in- 
volvement of experimental activity resulted in a consensus-proportional thinking skill (Schwarz & Linchevski, 
2007). N-gain with moderate category was also achieved in the proportional thinking component. Only a few 
students on the proportional thinking component attained high N-gain. Students with high N-gain supported 
the answer concerning the heat transfer rate of copper material, which was greater than that of steel mate- 
rial. Students provided answer coupled with scientific arguments in the form of mathematical calculations 
supplemented by conceptual support about the effect of thermal conductivity of the material. The students’ 
answers showed that EBR teaching developed students’ abstract thinking skill. The proportional thinking skill 
was students’ mental characteristic in cognitive competence dealing with abstract operation and hypotheses 
testing (Moreno, 2010). In addition, EBR facilitates students to make proportional and probabilistic prediction 
by posing question as elaboration of premise. Posing question draws students’ attention to focused questions, 
effectively supporting sustained reasoning (Lustick, 2010). 

The implementation of EBR in inquiry-based Physics teaching resulted in N-gain in the component of 
hypothetical-deductive reasoning and correlational thinking in low category. N-gain at low level was evident 
on the hypothetical-deductive reasoning component as shown in Table 2. Figure 1 also shows that student 
percentage based on N-gain was dominated by low category. Most students were not able to choose the 
choice alternative on the first level correctly, and they came up with incorrect reasons on the second level. 
Also, they were confident about the answer. Students’ answers were found incorrect when students learnt the 
phenomenon of heat transfer in some metals (copper, steel and aluminum), from which they learnt that the 
rate of heat transfer in copper was the greatest compared to the other two metals. Students chose the wrong 
answer by reducing the length of copper. It happened because the shorter metal produced a faster rate of 
heat transfer (Jatmiko, Prahani, Supardi, Wicaksono, Erlina, Pandiangan, & Althaf, 2018). Students gave illogical 
argument to what was in question. The student worksheet from the learning process showed that they had not 
been able to comprehend the comparison of data in the table of experiment result. As a corollary, they only 
referred to a single experiment. Students who were able to compare scores or scales did not relate the concepts 
of the material learned upon explaining the alternative choice of selected answers. This led to students’ weak 
hypothetical-deductive reasoning. The relevant research results explain that the process of interpretation 
linking evidence with scientific or intuitive rules is susceptible to misconception (Hardy, Kloetzer, Moeller, & 
Sodian, 2010). The result of N-gain corresponding to hypothetical-deductive reasoning skill also applied to the 
correlational thinking component with N-gain in low category. The N-gain in low category was supported by 
the dominant percentage of students attaining the N-gain low category on the correlational thinking compo- 
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nent. Students were not able to choose the alternative choice at the first level correctly; they formulated wrong 
reason on the question at the second level, and they were sure with the answer. Students’ ability to analyze 
the relationship between variables on the results of experiment data regarding heat transfer by conduction 
indicated low result. The student replied that metal length corresponded to the thermal conductivity of metal 
in that metal length influenced the rate of heat transfer. The answers indicated that students’ ability to analyze 
data was still weak, so they were unable to show correlation well (Jatmiko, Widodo, Martini, Budiyanto, Wicak- 
sono, & Pandiangan, 2016). In addition, the students were unable to gather relevant evidence with reinforced 
reasoning corroborated by evidence. This resulted in unreliable reasoning due to lack of relevant evidence. 

EBR posed a significance on the students’ scientific reasoning components in the 4 groups, showed similar 
results with a significance level of 5%. There was no significant difference in the application of EBR to students’ 
correlational thinking in 4 test groups with a significance level of 5%. Table 3 and 4 show consistency of students’ 
scientific reasoning taught using EBR. The conclusions on Table 3 and 4 prove that students need systematic 
intervention to stimulate thinking skills during learning (Erman, 2010). Student response informed that EBR 
activities in inquiry-based Physics teaching could help them engage in scientific reasoning, and teaching activi- 
ties could help them describe the EBR. In addition, they felt that learning activities could help them describe 
inquiry-based learning in general. Student responses also supported that the finding of empirical evidence but 
hypothetical-deductive reasoning results showed N-gain in low level. This situation resulted from the fact that 
the students were not convinced with the truth. Therefore, the teacher must identify misconceptions in their 
prior knowledge or concept before teaching basic concepts, identify reference from textbooks, and facilitate 
effective communication. This will make sure the information received by students is complete and correct 
(Erman, 2017; Lehrer & Schauble, 2006). Student responses to the application process showed the related 
interrelationship about making logical connections between premise and small value rule. These results were 
consistent with earlier indication showing that only 18% of students composed an explanation with claim, 
evidence support, and reasoning. EBR allowed students to construct claim based on logical premise and rule, 
but the student’s response in confirming the progress of knowledge was weak. Nevertheless, over 50% of 
students responded positively to the effectiveness of EBR in improving scientific reasoning. 


Conclusions 


The research results of and discussion on the effectiveness of EBR in improving students’ scientific rea- 
soning in Physics teaching draw several conclusions. First, the implementation of EBR results is the significant 
improvement on students’ scientific reasoning in Physics teaching, which is evinced by 2-tailed asymptotic 
significance for p < .0001. Also, the students’ scientific reasoning in Physics learning after the EBR application 
is found at the high category (control of variables), moderate (proportional and correlational thinking), and 
low (hypothetical-deductive reasoning and correlational thinking). Lastly, no significant difference is evident 
in the increase associated with each component of students’ scientific reasoning in Physics teaching in 4 
groups, as indicated by 2-tail asymptotic significance for p < .05. This research has implied that EBR effectively 
increased the components of scientific reasoning in inquiry-based Physics teaching, which comprises control 
of variables, proportional thinking, and correlational thinking. Students’ motivation also needs to be accrued 
at the outset of learning in order to draw their attention to the premise presentation. EBR needs to emphasize 
the clarification process on the interpretation of the learned concepts and the result of empirical verification. 
Precise clarification needs to be carried out before the application, therefore resulting an accurate claim. The 
resultant claim will be even more exemplary when instruction coupled with logical explanation is operative. 
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